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Abstract 

Recently the theory of widths of Kolmogorov-Gelfand has received 
a great deal of interest due to its close relationship with the newly 
born area of Compressed Sensing. It has been realized that widths re- 
flect properly the sparsity of the data in Signal Processing. However 
fundamental problems of the theory of widths in multidimensional 
Theory of Functions remain untouched, as well as analogous problems 
in the theory of multidimensional Signal Analysis. In the present pa- 
per we provide a multidimensional generalization of the original result 
of Kolmogorov by introducing a new hierarchy of infinite-dimensional 
spaces based on solutions of higher order elliptic equation. 

1 Introduction 

Recent interest to the theory of widths (especially to Gelfand widths) has 
been motivated by applications in Compressed Sensing (CS). In a certain 
sense the central idea of CS is rooted in the theory of widths, cf. e.g. [9], 
[7], [8], [30]. However, apparently this strategy works smoothly only in the 
case of representation of one-dimensional signals, while an adequate approach 
to multivariate signals is missing - one reason may be found by analogy in 
the fact that the theory of Kolmogorov-Gelfand widths fits properly only 
for one- dimensional function spaces (as pointed out below, e.g. in formula 
(23)). Recently, a new multivariate Wavelet Analysis was developed based on 
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solutions of elliptic partial differential equations ([15]), in particular "poly- 
harmonic subdivision wavelets" were introduced (cf. [10], [21]); in order to 
apply CS ideas to these wavelets it would require essential generalization 
of the theory of widths for infinite-dimensional spaces. We start with this 
motivation to study a generalization of the Kolmogorov-Gelfand theory of 
widths by introducing a new hierarchy of infinite- dimensional spaces based 
on solutions of higher order elliptic equations. However, there is a different 
perspective on the present research: its main purpose is to introduce this new 
hierarchy and to apply it to the theory of widths as a testing field. One may 
expect also that this development would throw a new light on the nature of 
sparsity in multidimensional Signal Analysis. 

In his seminal paper [14] Kolmogorov has introduced the theory of widths 
and has applied it ingeniously to the following set of functions defined in the 
compact interval: 

K, := |/ e AC^-' i[a,b]) : J^' |/(^) (t)]' dt < l| . (1) 

In the present paper we study a natural multivariate generalization of the 
set Kp which in a domain S C R" is given by 

K; := |ii e H'^P (B) : J lA^u (x)|' < l| , (2) 

n 

where is the p— th iterate of the Laplace operator A = '^^d'^ /dx"^; we 

consider more general sets K* given in (22) below. Wc generalize the notion 
of width in the framework of the Polyharmonic Paradigm, and obtain analogs 
to the one- dimensional results of Kolmogorov. 

The Polyharmonic Paradigm has been announced in [15] as a new ap- 
proach to Multidimensional Mathematical Analysis, which is based on solu- 
tions of higher order elliptic partial differential equations as opposed to the 
usual concept which is based on algebraic and trigonometric polynomials of 
several variables. It has proved to be very successful in the Moment Problem 
[20], Approximation and Interpolation [17], [18], and Spline Theory [19], [15]. 

The main objective of the present research is a new development of the 
Polyharmonic Paradigm. It provides a new hierarchy of infinite- dimensional 
spaces of functions which are used for a generalization of the Kolmogorov's 
theory of widths. This new hierarchy generalizes the usual hierarchy of finite- 
dimensional subspaces of the space C°° (/) for an interval 7 C R. The 
crux of this notion of hierarchy is the following: Let the domain D C R", be 
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compact with sufficiently smootfi boundary dD. Tlien tfie A?"— dimensional 
subspaces in C°° (/) will be generalized by spaces of solutions of elliptic 
equations (and by more general spaces introduced in Definition 14 below): 

Xn^{u: P2NU {x) = 0, for x e D} G L2 (D) ; (3) 

here P2N is an elliptic operator of order 2N in the domain D. Respectively, 
the simplest version of our generalization of Kolmogorov's theorem about 
widths finds the extremizer of the following problem 

infdist {Xn,K;) , 

where K* is the set defined in (2) and is defined in (3) for arbitrary 
elhptic operator P2N of order 2N; for the complete formulation see Theorem 
22 below. 

What is the reason to take namely solutions of elliptic equations in the 
multidimensional case is explained in the following section. 

1.1 The hierarchy of infinite-dimensional spaces - a 
justification via Chebyshev systems 

Let us give a heuristic outline of the motivation and the main idea of this new 
hierarchy of spaces, by explaining how it appears as a natural generalization 
of the finite-dimensional subspaces of C^~^ ([a, h]) in a compact interval [a, h] 
in R. 

First of all, let us understand the structure of the finite-dimensional sub- 
spaces of C^~^ {\a,h\): It is important to note that for a "general posi- 
tion" (or "generic") A^— dimensional subspace Xjy C C^^^ (/) in the in- 
terval / = (a, h) , there exists a finite or infinite number of subintervals 
h,j = {akj, bk,j) with \J = [a, b] , and a basis {wfcjJLi , 

Xn = span {lifelf^i , (4) 

(here span denotes the hnear closure) where the Wronski determinants satisfy 

SkjW {ui {t) ,U2{t) ,...,Uk{t)) > for i e (5) 
with Ekj = 1 or — 1. (6) 

A simplest example would be the space X2 :— span {1, t^} considered on the 
interval [—1, 1] , where the Wronskian W (1, t"^) changes sign at 0.^ 

^Note that there are cases where the system of functions {wfej^i has dimension 
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Since A. Markov it is known that the positivity condition (5)-(6) is char- 
acteristic for Extended Complete Chebyshev systems (called E'er— systems 
in [13], chapter 11; cf. also [23], chapter 2, section 5, Theorem 5.1). For 
that reason, we may formulate our important observation by saying that 
a "general position" A^— dimensional space Xj^ C (/) is a piecewise Ex- 
tended Complete Chebyshev system of order A^. 

We will remind some basic properties related to Extended Complete 
Chebyshev Systems. The following fundamental result describes their struc- 
ture (cf. [13], chapter 11, Theorem 1.1). 

Proposition 1 Let us assume that the space in (4) restricted to some 

subinterval J G I has sign- definite Wronskians as in (5) -(6). Then the 
restriction of the space Xjq to the interval J is a space of solutions for an 
ODE 

L^u (t) = 0, for t e J; (7) 
here Lj^ is an ordinary differential operator of order N in J, given by 

where the functions pk satisfy pk it) > in J. 

Let us remark that the weight functions pk may be chosen in different 
ways, cf . [26] . If we put for the Wronskians 

Wk —Wiui {t),U2 (t),...,«fc (t)) 

then the functions pk {t) may be written as 

p,^Wi^ Ui, P2 = W2/W^ 

Pk = for A; > 3, 

(cf. [31], [23], section 5, chapter 2, Theorem 5.1, or [13], chapter 11). 

Obviously, the operator Lp^ has a non- negative leading coefficient and is 
in this sense one-dimensional "elliptic". 

N but its Wronskian is on a whole interval, e.g. the system of two functions 
{t^, X {t) — X t^} in the interval [—1,1], where x is the Heaviside function. However 
this is an exception, hence not "generic". One may try to make the last precise: By intro- 
ducing a proper topology /metric in the set Sn of all A''— dimensional spaces in (!) , 
e.g. by taking the distance between the unit spheres in two spaces, we may prove that 
in the set Sn those spaces having Wronskian equal to are a "small set" in the sense of 
second category of Baire. 
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Remcirk 2 The detailed proof of Proposition 1 is a part of the general theory 
of Chebyshev systems developed by A. Markov, S. Bernstein, M. Krein and 

others, in which the Extended Complete Chebyshev systems are a special case 
which are of interest for us. Their theory is presented in detail in the above 
mentioned monographs [23] and [13], whereby in the first reference the case 
of non-differentiable systems is emphasized. 

Let us mention that the space Xjv generated by a Chebyshev system is 
often called Haar space, cf. [27]. Thus one may also say that a generic 
N — dimensional subspace of C^~^ (/) is piecewise Haar space. 

First, we will seek for a generalizable framework for the Extended Com- 
plete Chebyshev systems which we have obtained on every subintcrval Ij. 
The interpolation framework seems to be suitable: Let us note that condi- 
tion (5) has equivalent formulation as Hermite interpolation, in particular, 
for arbitrary to e (a, b) and constants {ck}k=o > possible to solve the 
interpolation problem 

u(f')(to) = Ck for A; = 0,l,...,iV- 1 (9) 

where u e X^. 

At this point it is important to emphasize that we will select judiciously, 
and generalize in the multivariate case, only those 2M— dimensional sub- 
spaces X2M = span {wfcj^ffj^ C C*^^^"^ (/) which satisfy a rather specific in- 
terpolation property: 

Definition 3 We say that the space X2M C C"^^^^ (/) has the Dirichlet 
BVP property, if for every subinterval Ii = [ai,6i] C /, and for arbitrary 
constants {cfc,(ifc}flQ^ , the (Dirichlet) boundary value problem 

«W(ai) = Cfe fork^O,l,...,M-l (10) 
= 4 for k^ 0,1,.. .,M -1 (11) 

has a solution u G X2m- 

Remark 4 Let us assume that in the space X2M there exists an Extended 
Complete Chebyshev system in I (i.e. a system satisfying positivity of the 
Wronskians (5)- (6) in I). Then X2M satisfies Definition 3 which follows 
from the very definition of Extended Complete Chebyshev systems, cf. [13], 
chapter 11. Thus the Extended Complete Chebyshev systems provide the main 
bulk of examples for Definition 3. 
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One may consider the solvability of problem (lO)-(ll) as a "parametriza- 
tion" of the space X2M by the Dirichlet boundary values {c^, dk}^^^ , and 
this important property will be generalized to the multivariate case. 

We are interested in the BVP interpretation which follows from Proposi- 
tion 1: Since the space X2M may be represented as 

X2M = {u : L2MU = for t e /} , 

for an elliptic operator L2M, then the solvability of problem (lO)-(ll) in the 
space X2M may be considered as a special case of the multidimensional theory 
for Elliptic Boundary Value Problems (BVP), and it is a classical BVP 
in the one-dimensional ODEs as well, cf. [28]. 

In view of the last observation, we seek for a multidimensional generaliza- 
tion of problem (lO)-(ll). Let D he a bounded domain in and consider 
the subspaces of L2 (D) . The space of solutions of an elliptic equation gen- 
eralizing equation (7) may be considered as a natural generalization of the 
space X2M- Indeed, if 

X2M = {u : P2MU (x) = ioTxeD}, (12) 

where P2M {x; D^) is an elliptic differential operator in the domain then 
the natural generalization to problem (10)- (11) is an Elliptic BVP, as for 
example the Dirichlet problem which may be considered for subdomains Di 
in D, namely 



P2MW {x) = for X e (13) 
u{y)^Ck{y) ioryedDi, for A; = 0,1,...,M-1. (14) 



dn 

Let us remind that the Dirichlet problem is well-known to be solvable for data 
{cfc (y)}fclo^ from a proper Sobolev or Holder space on the boundary dDi. An 
important point is that for a large class of operators P2M every solution of 
(13)-(14) may be approximated by solutions in the whole domain D, i.e. by 
elements of X2m- This may be considered as a substitute of the interpolation 
property (lO)-(ll) in the one-dimensional case. Very important hint for 
identifying the operators P2M which represent Multidimensional Chebyshev 
systems is provided by formula (8). This is the main reason for the judicious 
choice of the special class of operators P2M in Definition 14 below, as they 
mimic the operators in (8) and serve our purposes.^ 

Making analogy with the one-dimensional case (lO)-(ll), we may say 
that here the space X2M defined in (12) is "parametrized" by the Dirich- 
let boundary conditions (13), however the "parameter" {ck{y)}^^^ runs a 



^This generalization has been discussed in detail in [16]. 
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function space. Hence, the spaces X2M may be considered as a natural gen- 
eralization of the one-dimensional Extended Complete Chebyshev systems 
and we call them Multidimensional Chebyshev systems. 

After we have the Multidimensional Chebyshev systems in our disposal, 
the next step will be to introduce the multivariate generalization of the 
A?"— dimensional subspaces of C°° (/) . We will define them in Definition 14 
below as subspaces X^v of functions in C°° (D) which arc piecewise sohitions 
of (regular) elliptic differential operators of order 2N. We will say that Xn 
has "Harmonic Dimension N" and we will write 

hdim (Xn) = N, 

see Definition 14 below. Kolmogorov's notion of iV— width (and in a similar 
way Gelfand's width) is naturally generalized for symmetric sets by the notion 
of "Harmonic A"— width" defined by putting 

hdjv (S) := inf dist (X^, S) , 

hdim(XN)=N 

see Definition 21 below. The main result of the present paper is the com- 
putation of 

hd^ (k;) for N<p, 
where K* is defined in (2) and more generally in (22). 



1.2 Plan of the paper 

To facilitate the reader, in section 2 we provide a short summary of the 
original Kolmogorov's results. For the same reason, in section 3 we provide 
a short reminder on Elliptic BVP. In section 4 we prove the representation 
of the "cylindrical ellipsoid" set K* in principal axes which generalizes the 
one-dimensional representation of Kolmogorov, cf. Theorem 12 below. In 
section 5 we introduce the notion of Harmonic Dimension, and the First 
Kind spaces of Harmonic Dimension A". Based on it we define Harmonic 
Widths which generalize Kolmogorov's widths. In section 6, in Theorem 22 
we prove a genuine analog to Kolmogorov's theorem about widths. It says 
that among all spaces Xn having Harmonic Dimension A", some special space 
Xjsf provides the best approximation to the set K* in problem 

inf dist {Xn,k;) , 

and this space Xn is identified by the principal axes representation provided 
by Theorem 12. In section 7 we introduce Second Kind spaces of Harmonic 
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Dimension N and formulate a further generalization of Theorem 22. Ap- 
parently, the First and Second Kind spaces having Harmonic Dimension N 
provide the maximal generalization in the present framework. 

A special case of the present results is available in [22], and might be 
instructive for the reader to start with. 

A final remark to our generalization is in order. In our consideration we 
will not strive to achieve a maximal generality. As it is clear, especially in the 
applications to the theory of widths even in the one-dimensional case we may 
consider not all A^— dimensional subspaces but "almost all" A^— dimensional 
subspaces of C°° (D) in some sense, or a class of A^— dimensional subspaces 
which are dense (in a proper topology) in the set of all other A^— dimensional 
subspaces. This "genericity" point of view is essential in our multivariate 
generalization since it will allow us to avoid burdensome proofs necessary in 
the case of the bigger generality of the construction. For the same reason 
we will not consider elliptic pseudo-differential operators although almost all 
results have a generalization for such setting. 

Acknowledgements: The author acknowledges the support of the Alexan-| 
der von Humboldt Foundation, and of Project DO-02-275 with Bulgarian 
NSF. The author thanks the following Professors: Matthias Lesch for the 
interesting discussion about hierarchies of infinite-dimensional linear spaces, 
Hermann Render about advice on multivariate polynomial division, and Pe- 
ter Popivanov, Nikolay Kutev and Georgi Boyadzhiev about advice on Ellip- 
tic BVP. 

2 Kolmogorov's results - a reminder 

In order to make our multivariate generalization transparent we will recall 
the original results of Kolmogorov provided in his seminal paper [14] . Kol- 
mogorov has considered the set Kp defined in (1). He proved that this is an 
ellipsoid by constructing exphcitly its principal axes. Namely, he considered 
the eigenvalue problem 

„(2P) (^) = xu (t) for t e (0, 1) (15) 

^(p+j) (0) = (1) = for j = 0,l,...,p-l. (16) 

Kolmogorov used the following properties of problem (15)-(16) (cf. [25], 
Chapter 9.6, Theorem 9, p. 146, or [28], [29]): 

Proposition 5 Problem (15)-(16) has a countable set of non-negative real 
eigenvalues with finite multiplicity. If we denote them by Xj in a monotone 
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order, they satisfy Xj — > oo for j — > oo. They satisfy the following asymp- 
totic Xj = TT^^j^^ (1 + O . The corresponding orthonormalized eigen- 
functions form a complete orthonormal system in L2 ([0, 1]) . The 
eigenvalue A = has multiplicity p and the corresponding eigenfunctions 
{'^i}^=i '^'^^ basis for the solutions to equation u^^ (t) = in the interval 

(0,1)7 

Further, Kolmogorov provided a description of the axes of the " cyhndrical 
eUipsoid" Kp, from which an approximation theorem of Jackson type easily 
follows (cf. [25], chapter 4 and chapter 5). 

Proposition 6 Let / G L2 ([a, ^']) have the L2 — expansion 



f it) = E/^-^^- (^) ■ 

Then f & Kp if and only if 

For N > p + 1 and every f e Kp holds the following estimate ( Jackson type 
approximation): 



N 



< 



L2 



O 



N+l 



(17) 



{Kp) :— inf dist {X^, Kp) 



However, Kolmogorov didn't stop at this point but asked further, whether 
the linear space Xjy := {'ipj}^^i provides the "best possible approximation 
among the linear spaces of dimension N" in the following sense: If we put 

(18) 

the main result he proved in [14] says 

dr, (Kp)^ dist (^X^^KpY (19) 

Here we have used the notations, to be used also further, 

dist {X, Kp) 



sup dist (X, y) 

yeKp 



dist {X, y) — inf \\x — y\ 



(20) 
(21) 
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Hence, by inequality (17), equality (19) reads as 
d^iKp)^^^ ioTN>p 

dN{Kp) = 00 for A^ = 0, l,...,p- 1. 

Definition 7 The left quantity in (18) is called Kolmogorov N— width, 
while the best approximation space Xn is called extremal (optimal) sub- 
space (cf. this terminology in [33], [25], [29]). 

Thus the main approach to the successful application of the theory of 
widths is based on a Jackson type theorem by which a special space Xjv 
is identified. Then one has to find, among which subspaces Xjv is X^v the 
extremal subspace. Put in a different perspective : one has to find as wide 
class of spaces as possible, among which X^ is the extremal subspace. 

Now let us consider the following set which is a natural multivariate gen- 
eralization of the above set Kp defined in (1): For a bounded domain B in 

we put (more generally than (2)) 

K; := |« e (B) : J \L2pU {x)f dx < 1^, (22) 

where L2p is a strongly elliptic operator in B. Let us remark that the Sobolev 
space H"^^ (B) is the multivariate version of the space of absolutely continuous 
functions on the interval with a highest derivative in L2 (as in (1)). An 
important feature of the set K* is that it contains an infinite-dimensional 
subspace 

{u e H'^P (B) : L2pU (x) = 0, for x E B} . 

Hence, all Kolmogorov widths are equal to infinity, i.e. 

dj^ (k;) =00 for > (23) 

and no way is seen to improve this if one remains within the finite-dimensional| 
setting. 

The main purpose of the present paper is to find a proper setting in the 
framework of the Polyharmonic Paradigm which generalizes the above results 
of Kolmogorov. 

3 A reminder on Elliptic Boundary Value Prob-| 
lems 

Let us specify the properties of the domains and the elliptic operators which 
we will consider. In what follows we assume that the domain D, the differ- 
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ential operators and the boundary operators satisfy conditions for reguleir 
Elliptic BVP. Namely, we give the following: 

Definition 8 We will say that the system of operators {A; Bj, j = 1, 2, m}| 
forms a regular Elliptic BVP in the domain D c M." if the following 
conditions hold: 

1. The operator 

A{x,D,)= Yl {-lpD'^a^p{x)DP 
is a differential operator with a principal part defined as 

|a|+|^|=2m 

It is uniformly strongly elliptic, i.e. for every x E D holds 

Co iCf"" < \Ao {x, 01 < ci ICf"" for all real ^ e M" \ {0} . 

2. The domain D is bounded and has a boundary dD of the class C^"*. 

3. For every pair of linearly independent real vectors ^, rj and x & D the 
polynomial in z, Aq {x, ^ + zrf) has exactly m roots with positive imaginary 
parts. 

4-. The coefficients of A are in C°° (Z5) . The boundary operators Bj (x, D) =| 
hj^a{x) D'^ form a normal system, i.e. their principal symbols are 

\a\<.mj 

non- characteristic, i.e. satisfy Bjfi{x,^) = ^ bj^a (a^) C° 7^ for every 

\a\=Tnj 

X G dD and ^ ^ 0, ^ is normal to dD at x; they have pairwise different 
orders rrij which satisfy rrij < 2m for 1 < j < m, and their coefficients bj^a 
belong to C°° in dD. 

5. At any point x e dD let v denote the outward normal to dD at 
X and let ^ ^ Q be a real vector in the tangent hyperplane to dD at x. The 
polynomials in z given by Bj^ {x, ^ + zv) are linearly independent modulo the 
polynomial HfeLi (-^ — z'j, (0) where z'^ (0 denote the roots of Aq (x, ^ + zrf) 
with positive imaginary parts. 

Remark 9 With minor differences the above definition is available in [24] 
(conditions (i)-(iii) in chapter2, sectionb.l); in [32] (sections 5.11 andb.l2); 
in [12] (chapter 2Q); in [15] (section 23.2, p. 473;. 
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Let us define a special system of boundary operators called Dirichlet. We 

put 

B,= (0' fo.i = l,2,...,p-l 



Sj-i^] fori = l,2,...,p-l. 



Obviously, 



dn J 



OTd{Bj)=j-l, ord{Sj)=p + j -1. 



Let us denote by the operator formally adjoint to the elliptic operator 
L2p. There exist boundary operators Cj, Tj, for j' = 1, 2, — 1, such that 

ord (Tj) =2p- j, ord (Cj) = p-j 

and the following Green's formula holds: 

/ [L2pU ■ V — u - L2pv) dx — / {SjU ■ CjV — Bju ■ Tjv) day] (24) 

Jb j=0^dB 

here dn denotes the normal derivative to dB, for functions u and v in the 
classes of Sobolev, u.v G H"^"^ {B) (cf. [24], Theorem 2.1 in section 2.2, 
chapter 2, and Remark 2.2 in section 2.3). 

For us the following eigenvalue problem will be important to consider for 
U e H"^^ (B) , which is analogous to problem (15)-(16): 

L*2pL2pU (,t) = XU (x) for xeB (25) 

B^L2pU{y) = S,L2pU{y) = 0, for y e dB, j = 0,1, ...,p - 1 (26) 

where dn denotes the normal derivative at y G dB. It is obvious that the 
operator L2pL2p is formally self-adjoint, however the BVP (25)-(26) is not a 
nice one. Since a direct reference seems not to be available, we provide its 
consideration in the following theorem which is an analog to Proposition 5. 

Theorem 10 Let the operator be uniformly strongly elliptic in the do- 
main B. Then problem (25)-(26) has only real non-negative eigenvalues. 

1. The eigenvalue A = has infinite multiplicity with corresponding eigen- 
functions which represent an orthonormal basis of the space of all 
solutions to the equation L2pU (x) — 0, for x E B. 

2. The positive eigenvalues are countably many and each has finite mul- 
tiplicity, and if we denote them by Xj ordered increasingly, they satisfy 
Xj — > oo for j — > oo. 
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3. The orthonormalized eig en functions, corresponding to eigenvalues Xj > 
0, will be denoted by ■ The set of functions {'0j}jliU form 

a complete orthonormal system in L2 (B) . 

Remark 11 Problem (25)-(26) is well known to be a non-regular elliptic 
BVP, as well as non-coercive variational, cf. [1] ( p. 150 ) and [24] (Remark 
9.8 in chapter 2, section 9.6, and section 9.8 ). 

The proof is provided in the Appendix below, section 8. 



4 The principal axes of the eUipsoid K* and 
a Jackson type theorem 

Here we will find the principal exes of the ellipsoid K* defined as 

K; := |m e H^P {B) : J \L2pU {x)f dx < 1^, (27) 

where is a uniformly strongly elliptic operator in B. 

We prove the following theorem which generalizes Kolmogorov's one- 
dimensional rcsTilt from Proposition 6, about the representation of the el- 
lipsoid Kp in principal axes. 

Theorem 12 Let f e K*. Then f is represented in a L2— series as 

00 00 

/ (^) = (^) + E/^-^^- (^) ' 

where by Theorem 10 the eigenfunctions ip'j satisfy A^ipj {x) ~ while the 
eig enf unctions ipj correspond to the eigenvalues Xj > 0, and also 

00 

E^^// ^ 1- (28) 
j=i 

00 00 

Vice versa, every sequence U {/jljli E I/j'I + E I-^-? '^ °° 

00 

and ^^Xjfj < 1 defines a function f & L2 (B) which is in K*. 
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Proof. (1) According to Theorem 10, we know that arbitrary / G -L2 (B) is 
represented as 

00 00 

j=l j=l 

CO 00 

11/111= Ei/;r+Ei/.i'<- 

with convergence in the space L2 {B) . 

(2) Prom the proof of Theorem 10, we know that if we put 

<Pj (x) = L2pi'j (x) for J > 1, 

then the system of functions 



for j > 1 



is orthonormal sequence which is complete in L2 (B) . 

(3) We will prove now that if / G L2 (B) then f e K* iS 

00 

00 

Indeed, for every / G H^^ (B) we have the expansion / (x) = ^^/jVj (x) + 

3=1 

00 

'^^fj'ipj (x) . We want to see that it is possible to differentiate termwise this 
expansion, i.e. 

00 00 
L2pf (x) = J^fj^'^p^j (^) = E/.?'^^' 

Since < > is a complete orthonormal basis of L2 {B) it is sufficient to 

I V J j>i 
see that 

j L2pf (x) (pjdx = J (^Y^fjL2pipj {x)j (pjdx. 
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Due to the boundary properties of (pj and since (pj — L2pipj, we obtain 

/ L2pf (x) (j)jdx = / / (x) L*2p(j)jdx = \j / f^jdx = Xjfj. 
Jb Jb Jb 

On the other hand 

(^^fk<Pk {x)j (pjdx = Xjfj. 

Hence 

CO oo oo ' ( ) 

L2pf {X) = ^fjL2p^j {X) = ^fj<i)j (X) = ^./X'jfj^y^ 
j=l j=l j=l V'^j 



and since \ > is an orthonormal system, it follows 



II Will = E^^/: 



oo 

2 
3 



Thus iifeKp it follows that ^\jf^ < 1- 



oo 



Now, assume vice versa, that ^^/j Aj < 1 holds together with + 

J=l 3=1 

oo 

\fj\^ < oo. We have to see that the function 

3=i 

oo oo 

/ (^) = J2f3^3 (^) + E/^-^^- (^) 

belongs to the space H^^ (B) . Based on the completeness and orthonormality 
of the system \ ^^y= \ we may define the function g( e L2 by putting 

3=i 



00 / / \ 00 



(bj 

it obviously satisfies WgW^^ < 1- 



3=1 V'^J j=i 
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Prom the local solvability of elliptic equations ([24]) there exists a function 
F e H'^'P (B) which is a solution to equation L2pF — g. Let its representation 
be 

oo oo 



with some coefficients Fj satisfying \Fjf < oo. As above we obtain 



Xj / Fipjdx = / FLlpL2pipjdx = / L2pF ■ L2pipjdx 
JB Jb Jb 

— g ■ 4>jdx 
Jb 

which implies Fj — fj. Hence, F — f and / e H'^^ (B) . This ends the proof. 
■ 

We are able to prove finally a Jackson type result as in Proposition 6. 

Theorem 13 Let N > 1. Then for every N > 1 and every f E K* holds the 
following estimate: 



N 



j=i j=i 



< 



L2 



N+l 



Proof. The proof follows directly. Indeed, due to the monotonicity of Xj, 
and inequality (28), we obtain 



N 



j=l 3=1 



This ends the proof. 



Xj 



5 Introducing the Hierarchy and Harmonic 
Widths 

In the present section we introduce the simplest representatives of the class 
of domains having Harmonic Dimension N, which are called First Kind 
domains. They are piece- wise solutions to regular elliptic equations. 
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Definition 14 Let D C be a bounded domain. For an integer M > 1 
we say that the linear subspace Xm C L2 (D) is of First Kind and has 
Harmonic Dimension M, and write 

hdim (Xm) = M, (29) 

if the following conditions are fulfilled: 

1. There exists a finite number of domains Dj with piece-wise smooth 
boundaries dDj (which guarantees the validity of Green's formula (24)), whicl^ 
are pairwise disjoint, i.e. [^Dj — for i ^ j, and such that we have the 
domain partition 

D^ljDj. (30) 

j 

2. We assume that for j = l,2,...,/c the factorization operators 
Qj {x, Dx) are uniformly strongly elliptic in the domain D and, the func- 
tions pj defined in D are infinitely smooth and satisfy 

k k 

Z ■.= \J{x e D : {x) = 0} C U dD^ \ dD. 
j=i j=i 

k 

We assume that ord (Qj) — 2Nj and '^^2Nj — 2M. Define the operator 



P2M {x, Dx) u {x) = mQ.{x,D,)^-\u{x) (31) 

for the points x & D where it is correctly defined (out of the set Z ). 

We specify the interface conditions: Let us denote by Ui = u\d- the restric- 
tion of u to Di. If for some indexes i ^ j, the intersection H := ODi ^dDj 
has nonempty interior in the relative topology of dDi (hence also in dDj) 
then the following interface conditions hold on H in the sense of traces: 

{-t) ' = {-t) ' /- * = 0. 1. 2^ - 1^ (32) 

here the vector n^. denotes one of the normals at x to the surface dDiP\dDj. 
We define the space Xm by putting 



Xm = 1 ^ e //^^ (D) : P2M« (a;) = 0, for x e [j'^^D,, 
and u satisfies the interface conditions (32) 



(33) 
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Remcirk 15 1. In [22] we considered the case of spaces Xj^ of Harmonic 
Dimension N defined by a single elliptic operator P2N (i-e. P2N — Qi) o-nd 
a trivial partition of D, i.e. D = Di. 

2. Let us comment on the interface conditions (32) in Definition I4. 
Let us assume that we have an elliptic operator P2N with smooth coefficients 
defined on D and that a non-trivial partition |J Dj is given. Due to the piece- 
wise smoothness of the boundaries dDj we may apply the Green formula, and 
from the interface conditions (32) it follows that "analytic continuation" is 
possible, hence every function in is a solution to P2NU = in the whole 
domain D (see similar result in [15], Lemma 20.10, and the proof of Theorem 
20.11;. 

3. One may choose a different set of interface conditions which are equiv- 
alent to (32), see [15] (Remark 20. 12^, and [24] (Lemma 2.1 in chapter 2). 

4. The spaces Xn defined in Definition I4 mimic in a natural way the 
one- dimensional case: the operator P2M (31) is similar to the operator (8) 
in Proposition 1. 

5. The operator Y\j Pj ■ P2M does not have a singularity in the principal 
symbol but eventually only in the lower order coefficients. 

Here is a simple non-trivial example to Definition 14: 

Di 
D 

Pl{x-D,)u{x) 
Pl{x-D,)u{x) 

where A is the Laplace operator. Typical elements of X2 are the functions 
u which are obtained as solutions to 

Ati = (1 — \x\) w in D, 

where Aw = in D. 

The following result shows that we may construct a lot of solutions be- 
longing to the set Xm of Definition 14. We call these "direct solutions". 

Proposition 16 There is a set of boundary conditions B(^, i — 1,2, M on 
dD such that problem 

P2MU (x) — for X & D 
Beu(y)^he(y) foryedD, and £ ^ 1,2, M 



= {x : \x\ <1} , D2 = {x : 1 < \x\ < 2} 
= {x : |x| < 2} 

= A — \—rAu (x) for X e Di 

1 — \x\ 

= —A- i — 7 An {x) for x e D2, 
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is solvable for arbitrary data {hj^}^i from the corresponding Sobolev spaces, 
i.e. hi e if 2M-ord(B^)-i/2 (^Qjj^^ ^ Q^id the solution has the maximal regularity, 
i.e. ueH^^{D). 

Proof. For every j with 1 < j < k we choose boundary operators for 
m — 1,2, Nj for a regular elliptic BVP {Qj {x, D^) ; Bj.^, m — 1,2, Nj} .| 
If we have the data function f on D and h^^^ — {/ij,m}j„Li boundary 
dD then the solution of the eUiptic BVP 

QjW = / on D (34) 
Bj mW — hj^rn, On dD, for m — 1,2, Nj (35) 

in case it exists will be denoted by Ij (/, h^^^^ We may write inductively 

u = pkh (• • ■P2I2 {pih (0; h^^^) ; h^^^) ■ ••) . 

For simplicity of notation let us assume that k = 2. Then the boundary 
conditions satisfied by u are obtained from 

Qiw = 

Bi,mW^h^rn for m = 1, 2, A^i 



and 



Q2 (—u) = piw 

B2,m—u = h2,m ioi m = 1,2, N2 

P2 



hence, we obtain 



-Bi,m ( —Q2 i—u ) 1 = hi^rn for m = 1, 2, A^i. 



.Pi \P2 

Thus we see that the system of boundary operators on dD 

B2,m—u, for m = 1,2, A^2 

P2 

(^^Q2 form = l,2,..,iVi 



■^For the solvability recall that there is a finite number of conditions which have to 
be satisfied by the data {/, /ij,m} which guarantee the solvability, cf. [24] (Theorem 5.3, 
chapter 2, section 5.3). 
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is normal. Let us put 




for j = l,2,...,Ar2 



Pi \P2 



U 



) 



) 



for j = l,2,...,7Vi. 



A simple direct check shows that the orders of the system of operators 



differ, and also satisfy the condition for being "non-characteristic" on the 
boundary, cf. Definition 8, item 4). We may proceed inductively to prove 
the statement for arbitrary /c > 3. 
■ 

Remcirk 17 Apparently, one may prove that the set of "direct solutions" ob- 
tained in Proposition 16 is dense in the whole space Xm defined in Definition 



The following fundamental theorem shows that, as in the one-dimensional 
case, on arbitrary small sub-domain G 'vciD with G H (U ^^j) — the space 
Xm with hdim {Xm) — M has the same Harmonic Dimension M. From a 
different point of view, it shows that a theorem of Runge-Lax-Malgrange 
type is true also for elliptic operators with singular coefficients of the type of 
operators P2M considered in Definition 14. 

Theorem 18 Let the First Kind space Xm satisfy Definition I4 with 



Assume that the elliptic operator P2M which corresponds to the space Xm has 
factorization operators Qj (from (31)) satisfying condition {U)^ for unique- 
ness in the Cauchy problem in the small."^ Let G be a compact subdomain in 
some Dj, i.e. ((J dDj) — 0. Then the set of "direct solutions" considered 
in Proposition 16 is dense in L2 (G) in the space 



'^The differential operator P satisfies condition ({/)^ for uniqueness in the Cauchy prob- 
lem in the small in G provided that if Gi is a connected open subset of G and u G (Gi) 
is a solution to P*u = and u is zero on a non-emplty subset of Gi then u is identically 
zero. Elliptic operators with analytic coefficients satisfy this property (cf. [4], part //, 
chapter 1.4; [5], p. 402). 



{Bj: 1,2,..., m + N^} 



14. 



hdim (Xm) = M. 



{u e H^^ (G) : P2MU = inG}. 
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Proof. For simplicity of notations we assume that for the eUiptic operator 
P2M associated with Xm, by Definition 14, we have only two factorizing 

operators Qi and Q2, i.e. P-2mu = Qij^Q2 (^^) • 

Let us take a solution u e H'^^ (G) to P2MU = in C We have 

Q1—Q2 (—u) - in G 
Pi \P2 J 

and we use the solutions Ij for the Elliptic BVP (34)- (35) considered in the 
domain G, to express arbitrary solution as 

where the boundary data h^^^ and h^^^ are arbitrary in proper Sobolev spaces. 
By the approximation theorem of Runge-Lax-Malgrange type (cf . [5] , Theo- 
rem 4, and references there), which uses essentially property {U)^ of operator 
Ql, we obtain a function Ws which is a solution to Qiw^ = in D and such 
that 

Next we apply the same approximation argument but with non-zero right- 
hand side Pill (O; /i^^^) (cf. [6]) to prove the existence of a function such 
that 

||/2(pi/i(0;/i«);/i(2))-y,||<C£ 

for some constant C > 0, where the constant C depends on the functions pj. 
Thus we obtain the function 

Ue = p2Ve 

which satisfies 

and is a "direct solution" in the sense of Proposition 16. 
■ 

The following theorem studies the orthogonal complement Xjq Xm of 
two First Kind spaces where M < N. While we will not need the whole 
generality of the result proved, the proof shows that X^ Q Xm has at least 
hdim equal to — M. 

Theorem 19 Let M < N and the First Kind spaces Xm, Xn satisfy Defi- 
nition 14 with 

hdim (Xm) = M, hdim (Xjv) = N. 

Assume that the elliptic operator P2N1 which is associated with the space 
Xn, has (by (31)) factorization operators Qj satisfying condition {U)^ for 
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uniqueness in the Cauchy problem in the small (as in Theorem 18). Then 
the space Y — Xjsf \ Xm is infinite- dimensional. 

Proof. (1) Let, by Definition 14, the partition [jDj and the operator P2M 
correspond to Xm, while the partition |J D'j and the operator Pgjv correspond 
to X^v- Assume that Dif]D[ 7^ 0. Then we will choose a subdomain G which 
is compactly supported in Di f] D[. 

Further we will fix our attention to the subdomain G where both operators 
P2M and PgAT are uniformly strongly elliptic and will construct a subset of 
Xn Xm restricted to the domain G. Let us be more precise: If we denote 

by 

X^ := {u : H^^ (G) : P^^u = in G} (36) 

then we will construct an infinite-dimensional subspace of X^ Q X^. 

(2) For the uniformly strongly elliptic operator P2M on the domain G 
we choose the Dirichlet system of boundary operators Bj = J^jrrr, for j > 
1, which are iterates of the normal derivative ^ on the boundary dG. As 

already mentioned the system of operators |p2m; ^ '■ j — 0,1, M — 1^ 

on G forms a regular Elliptic BVP (this is the Dirichlet Elliptic BVP for the 
operator P2m) (cf. [24], Remark 1.3 in section 1.4, chapter 2). 

We complete the system {-Bj}^^ by the system of boundary operators 

= fo^^ j = 1' 2, ...M. Hence, the system composed {Bjj'^l^ [j {Sj}f^^ 

is a Dirichlet system of order 2M (cf. [24], Definition 2.1 and Theorem 2.1 in 
section 2.2, chapter 2). Further, by [24] (Theorem 2.1), there exists a unique 
Dirichlet system of order 2M of boundary operators {Gj,Tj}^-^ which is 

uniquely determined as the adjoint to the system {Bj, Sj}^^ , and the Green 
formula (24) holds on the domain G. We will use this below. 

(3) In the domain G we consider the elliptic operator P2nP2m- ^ 
product of two strongly elliptic operators it is such again. By a standard 
construction cited above (cf. [24], Theorem 2.1, section 2.2, chapter 2), we 
may complete the Dirichlet system of operators {Bj,Sj}^^-^ with N — M 

boundary operators Rj — g^^M-i+j , j — 1,2, N — M. Again by the above 
cited theorem, the Dirichlet system of boundary operators 

covers the operator P2nP2M- Finally, we consider the solutions g e f/"2Ar+2M (^Q^^^ 
to the following EUiptic BVP: 

^2iv^2V(^) = forxeG (37) 

Bjg (y) = Sjg (y) = for j = 0, 1, - 1, for y e dG (38) 
RjQ (y) = hj (y) for j = 1, 2, AT - M, for y e dG. (39) 
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We may apply a classical result [24] (the existence Theorem 5.2 and The- 
orem 5.3 in chapter 2), to the solvability of problem (37)-(39) in the space 

^2M+2N 

(4) Let us check the properties of the function P2m9 where g satisfies 
(37)-(39). First of all, it is clear from (37) that P2m9 ^ where we have 
used the notation (36). 

By Green's formula (24), apphed for the operator P2M and ior u — g we 
obtain 

P2M9 ■ ''^dx — for all V with P2m'v — 

which imphes that the function P2m9 satisfies P2m9 -L {-^m defined as 
(36)). 

By the general existence theorem for Elliptic BVP used already above (cf. 
[24], Theorem 5.3, the Fredholmness property), we know that a solution g 
to problem (37)- (39) exists for those boundary data {/ij}^^ which satisfy 
only a finite number of hnear conditions (cf. [24], conditions (5.18)); these 
are determined by the solutions to the homogeneous adjoint Elliptic BVP. 
Hence, it follows that the space Y^_j^ of the functions P2m9 where g is a 
solution to (37)- (39) is infinite-dimensional. 

(5) Let us construct a subspace of Xp^\Xm which is infinite-dimensional. 
We use the obvious inclusion Xn\g ^m\g C X^, where for a space 
of functions Y C I/2 (-B) the space Y\g consists of the restrictions of the 
elements of Y to the domain G. 

First of all, we find an orthonormal basis {vj}jyj^ in the infinite-dimensional 
space Y^_j^ (where the norm is IHI^^CG) )' Gram-Schmidt orthonor- 

malization we obtain functions gj such that Vj = P2M9j f*^^ i ^ 1- 

Let us put Ej = ^j=T and use the density Theorem 18 to choose Uj e 
H^^ (D) with 

II%-^jIIl2(G) forj>l. 

The orthogonahty of vj to X^ infers dist {uj\G, X^) > i — Sj in the L2 (G) 
norm. Hence, dist {uj, Xm) > 1 — £ j in the L2 {D) norm, hence Uj ^ Xm- 
Let us see that for every choice of the constants aj holds 

N-l 

"^^ajUj 7^ un- 
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Indeed, by the triangle inequality for the norm IHI^jCG) follows 



7V-1 



vn 



N-l 

E 



N-l N-l 

Vn - UN + UN - '^ajUj + ^ 

j=l 3=1 



N-l 

E 

i=i 



<£n + 



N-l 

un — y^^ajWj 



or 



N-l 



N-l 

E 



UN 



aj \ £j 



N-l 

E 

3=1 



Obviously 



iV-l .^2 



and since the left-hand side always exceed 1/4, this ends the proof that the 
system of functions {ujja}^^^ is linearly independent. Hence, the system 
{'^j}j>i linearly independent in the whole domain D. 

As noted above Uj ^ Xm, hence span {wjj^.^j^ is the infinite-dimensional 
space we sought The proof is finished. 
■ 

We have the following prototype of Theorem 19, proved in [22]. 

Corolleiry 20 Let M < N and Xm, Xn satisfy Definition 14 with 

hdim (Xm) = M, hdim (Xn) = N. 

Assume that the differential operators P2M o-nd P2JV! associated with Xm and 
Xn, have trivial factorization operators by the definition (31), and trivial 
domain partitions D — Di and D — D[ by (30). Then the space of solutions 
of the Elliptic BVP (37)- (39) where G — D is a subspace of the space 

Y = XnQXm. 

The proof may be derived from the proof of Theorem 19 where we have 
put G — D. Note that we do not need the (U)^ condition for the operator 
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P2iv Hence, strictly speaking, Corollary 20 is not a special case of Theorem 
19. 

Now we provide a generalization of Kolmogorov's notion of width from 
formula (18); without restricting the generality we assume that we work only 
with symmetric subsets. 

Definition 21 Let A be a centrally symmetric subset in L2 (B) . For fixed 
integers M > 1 and N > we define the corresponding Harmonic Width 
by putting 

Mm,n {K) := inf dist (Xm©F^, A) , 

where vaixM,FN taken over all spaces Xm, Fn C C°° {B) with 

hdim (Xm) = M 
dim (Fn) = N. 

6 Generalization of Kolmogorov's result about] 
widths 

Next we prove results which are analogs to the original Kolmogorov's results 
about widths in (19). 

We denote by Fn a finite-dimensional subspace of L2 {B) of dimension 
N. We denote the special subspaces for an elliptic operator = by 

Xp := {u e H^P (B) : L2pU (x) = 0, for x E B} , (40) 

and the special finite-dimensional subspaces 

Fn {i^j : j < N}^^^ (41) 

where ijjj are the eigenf unctions from Theorem 10. 

Theorem 22 Let K* be the set defined in (27) as 




with a constant coefficient operator L2p which is uniformly strongly elliptic 
in the domain B. Let Xm be a First Kind subspace of L2 (B) of Harmonic 
Dimension M, according to Definition I4, i-e. 

hdim (Xm) = M, 
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and let N > be arbitrary. 

1. IfM<p then 

dist {Xm®Fn, K;) = oo. 

Hence, 

\ni dist (Xm0F^, K;) = oo 

or equivalently, 

hdu.N (K*) = oo. 

2. IfM^p then 

inf dist (Xp0Fjv, K;) = dist (Xp^Fj,, K*\ , 

i.e. 

hdp,N (k;) = dist (x^eFjv, x;) . 

Remcirk 23 /n 5oi/i cases we see i/iai t/ie special spaces Xj^^^Ff^f are ex- 
tremizers among the large class of spaces Xm^F^. 

Proof. 1. If we assume that Xm and Xp are transversal the proof is clear 
since Xp C K* and there will be an infinite-dimensional subspace in Xp C K* 
containing at least one infinite axis with direction f & Xp\ Xm, such that 

dist {Xm^Fn, /) > 

which implies 

dist (XM0F^,i^;) =oo. 

If they are not transversal we remind that operators with analytic coefficients 
satisfy the (f/)^ condition, and we may apply Lemma 24. 

2. For proving the second item, let us first note that Xp C Xp^Fpf. 
Indeed, since Xp C K* the violation of Xp C Xp0F/v would imply that 
there exists an infinite axis / in K* not contained in Xp^Fj^f which would 
immediately give 

dist(XpeF;v,i^;) = oo. 

Using the notations of Definition 14, there exists a finite cover (J Dj — B, and 
by Lemma 27 (applied for M = N = p) it follows that on every subdomain 
Dj holds = Cj {x) for some function Cj (x) . Thus we see that every 
M e is a piecewise solution of L2pU = on B, satisfying the interface 
conditions (32) in Definition 14. Here we use an uniqueness theorem for 
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"analytic continuation" across the boundary argument (proved directly by 
Green's formula (24) as in [15], Lemma 20.10 and the proof of Theorem 20.11, 
p. 422) that u G Xp, hence Xp = Xp. 

Further we follow the usual way as in [25] to see that Fjv is extremal 
among all finite-dimensional spaces F/v, i.e. 

inf dist (x^eFjv, X;) = dist (Xp^F^, X;) . 

This ends the proof. 
■ 

Wc prove the following fundamental result which shows the mutual posi- 
tion of two subspaces: 

Lemma 24 Assume the conditions of Theorem 19. Let the integer Mi > 0. 
Then 

dist {Xm®Fmi,Xn) = oo. 

The proof follows directly from Theorem 19 since a finite-dimensional 
subspace would not disturb the arguments there. 
We obtain immediately the following result. 

Corollary 25 Let us denote by Un+i the unit ball in Xjv+i in the I/2 (-S) 
norm. Then 

dist (Xtv, [/iv+i) = 1. 

Remark 26 Lemma 24 and especially the above Corollary may be considered 
as a generalization in our setting of a theorem of Gohberg-Krein of 1957 (cf. 
[25], Theorem 2 on p. 137 ) in a Hilbert space. 

We need the following intuitive result which is however not trivial. 

Lemma 27 Let for the strongly elliptic differential operators L2N = P2N {x; D^)^ 
and P2M — P2M {x; D^) of orders respectively 2N < 2M in the domain B, 
the following inclusion hold 

X^nH'"" {B) cXm\F, 

or 

{u e H^^ (B) : L2NU (x) =0, xeB} C 
(l{ue H^^ {B) : P2MU {x) = 0, xeB}\F, 

where F C L2 (B) is a finite- dimensional subspace of L2 (B) . Then 

P2M {x, D^) = P2M-2N {^^ Dx) L2N {x, D^) (42) 
for some strongly elliptic differential operator P2M-2N of order 2M — 2N. 
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Proof. It is clear that the arguments for proving equahty (42) are purely 
local, and it suffices to consider only xq — 0, or we assume that the operator 

L2N has constant coefficients. 

First, we assume that the polynomial L2N (C) is irreducible. Then we 
consider the roots of the equation 

L2N (C) - for C e C". (43) 

If C is a solution to (43) then the function v (x) — exp{{(,x)) is a solution 
to equation L2NV = in the whole space. Hence 

P2MV = P2M {xo; Dx) V = P2M {xo; C) = 0, 

and by a well-known result on division of polynomials in algebra [34] (The- 
orem 9.7, p. 26), the statement of the theorem follows. 

Now let us assume that L2N is reducible and decomposed in two irre- 
ducible factors L2N = Q2Q1, which may be equal. Obviously, both poly- 
nomials Qi and Q2 are uniformly strongly elliptic. Since the solutions to 
Qiu — are also solutions to L2N it follows by the above that 

P2M {x, D^) = P2V-2JV1 ('^i Da;) Qi (D^) 

where 2Ni is the order of the operator Qi. Further, following the standard 
arguments in [24], by the uniform strong ellipticity of the operator Qi, for 
every ^ G C", and for arbitrary s > 2iVi, there exists a solution u e (B) 
to equation 

Qiu^ (x) = e<^'^> for x e B. 
Let C e be a solution to equation Q2 (C) = 0. Obviously, 

L2NU^ = 

hence, by the above it follows 

P2M {x, D^) = P2M-2N1 D^) Qi (D^) Ui; = P2M-2N1 C) = 0. 

It follows that P2M-2N1 (^0, C) — 0- We proceed inductively if L2N has more 
than two irreducible factors. 



7 Second Kind spaces of Harmonic Dimen- 
sion N and widths 

In order to make things more transparent, in Definition 14 we avoided the 
maximal generality of the notions and considered only First Kind spaces of 
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Harmonic Dimension N. Let us explain by analogy with the one-dimensional 
case how do the " Second Kind" spaces of Harmonic Dimension N appear. 

In the one-dimensional case, if we have a finite-dimensional subspace 
Xjsf C (/) then for a point xq & I the space 

Y -.^{ueXN-.u (xo) = 0} 

is an {N — 1) —dimensional subspace. We would hke that our notion of 
Harmonic Dimension N behave in a similar way. For example, if is 
defined as a set of solutions of an elliptic operator P2N by 

Xn := {u e H^^ (B) : P2NU = in B} 

then it is natural to expect that the space 

Y -.^{ueXN-.u^O on dB} 

has Harmonic Dimension TV — 1. A simple example is the space 

Y ^{ueH"^ (B) : A^-u = inB, u^O on dB} . 

On the other hand, it is Theorem 19 and Corollary 20 above which show 
that such Second Kind spaces of Harmonic Dimension appear in a natural 
way when we consider the space X^QXm based on solutions of Elliptic EVP 
(37)-(39). 

We give the following definition. 

Definition 28 For an integer M > 1 we say that the linear subspace Xm C 
L2 (D) is of Second Kind and has Harmonic Dimension M, and write 

hdim {Xm) = M, 

if it satisfies all conditions of Definition I4 however with an elliptic opera- 
tor P2N, with N > M and all elements u e Xm satisfy N — M boundary 
conditions 

BjU = on dD, j = 1, 2, TV - M. 

Here the boundary operators {-Bj}^'^ are a normal system of boundary 
operators defined on dD, by Definition 8, item 4)- 

By a technique similar to the already used we may prove the following 
results which generalize Theorem 22. We assume that K* is the set defined 
by (27) with a strongly elliptic constant coefficients operator L2p. The space 
Xp is defined by (40) and the space Fl by (41). 

The following theorem is a generalization of item 1) in Theorem 22. 
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Theorem 29 Let M < p and L > be arbitrary integer. Let Xm be a 
Second Kind space with Harmonic Dimension N, i.e. 

hdim (Xm) = M. 

Let Fl be an L— dimensional subset of L2 (B) . Then 

dist {Xm®Fl,K;)^oo. 

The proof of Theorem 29 follows with minor modifications of Lemma 24 
(Theorem 19). 

It is more non-trivial to consider the case N = p. First we must prove the 
following result. 

Lemma 30 Let Xp be a Second Kind space of Harmonic Dimension p and 
L > be an arbitrary integer. Let Fl be an L— dimensional subset of L2 (B) . 
Then 

dist {Xp^Fl, K;) < 00 

implies 

Xp C Xp. (44) 

Let the elliptic operator P2M o-nd the boundary operators {Bj}.^^ be associ- 
ated with Xp by Definition 28. Then (44) implies the following factorizations. ■ 

Bj = B'jL2p for 1,2,..., M- p. 

The operator P2M-2P ^-^ uniformly strongly elliptic in D, and the boundary 
operators {-Bj}^^^^'' form a normal system which covers the operator P2M-2p- 

Finally, the following generalization of item 2) in Theorem 22 may be 
proved. It shows that one needs to take into account the index of the Elliptic 
BVP involved. 

Theorem 31 Let us consider those spaces Xp of Second Kind with Harmonic 
Dimension p for which 

dist {Xp@Fl,k;) <^ 

with associated operators P2M o-nd boundary operators {Bj}^^ . Following 
the notations of Lemma 30, let us denote by Af the following space of solutions 
w e H^^-^P (D) of the Elliptic BVP on the domain D: 

P2M-2p'^ = onD 

B'jW = 0, on dD, for j = 1, 2, M -p 
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Then the following equality holds 



inf {dist {Xp^Fl, K;) : dim {Af) + L ^ L^} = dist (Xp^FL^K*) . 

From the theory of EUiptic BVP is known that dim (A/") < oo (cf. [24], 
Theorem 5.3, chapter 2, section 5.3). Let us denote by {uJs]'^g^i^^ a basis of 
the space and by Ug a fixed solution to L2pUs = Wg- The main point in 
the proof of Theorem 31 is that arbitrary solution u to equation P2MU — 
may be expressed as 

dim(A^) 

U = ^ XgUs + V 
s=l 

where v is a solution to L2pV — 0. 



8 Appendix, Proof of Theorem 10 

Proof. (1) We consider the following auxiliary elliptic eigenvalue problem 

L2pLlp(p {x) = \<p (x) on B, (45) 

B^4> {y) = S,<P {y) = for j = 0, 1, - 1, for y G dB. (46) 

Since this is the Dirichlet problem for the operator L2pL2p it is a classical 
fact that (45)- (46) is a regular Elliptic BVP considered in the Sobolcv space 
H^^ (B) , as defined in Definition 8. Also, it is a classical fact that the 
Dirichlet problem is a self-adjoint problem (cf. [24], Remark 2.4 in section 
2.4 and Remark 2.6 in section 2.5, chapter 2). 

Hence, we may apply the main results about the Spectral theory of regular 
self-adjoint Elliptic BVP. We refer to [11] (section 3 in chapter 2, p. 122, 
Theorem 2.52) and to references therein. 

By the uniqueness Lemma 32 the eigenvalue problem (45)-(46) has only 
zero solution for A = 0. It has eigenfunctions (pk £ (B) with eigenvalues 
Afc > for k = 1,2, 3, ... for which — > oo as A; — > oo. 

(2) Next, in the Sobolev space H^^ {B) , we consider the problem: 

L2pL*2p(p (x) = 0fe (x) on B (47) 

Bjcp (y) = Sjip (y) = for j = 0, 1, - 1, for y e dB. (48) 

Obviously, the Elliptic BVP defined by problem (47)-(48) coincides with 
the Elliptic BVP defined by (45)-(46) up to the right-hand sides, and all 
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remarks there hold as well. Hence, problem (47)-(48) has unique solution 
cpk e H^P (B) . We put 

Hence, L2pipk = 0fc- Wc infer that on the boundary dB hold the equalities 
BjL2piJJk = Bj(pk and SjL2pipk — Sj4>k', since 4>k are solutions to (45)-(46) it 
follows 

BjL2pipk (y) = SjL2p^k (y) = for j = 0, 1, ...,p- 1, for y e dB. (49) 

We will prove that tpk are solutions to problem (25)-(26), they are mutu- 
ally orthogonal, and they are also orthogonal to the space {v e H'^^ : L2pV — 0} .| 

(3) Let us see that 

L*2pL2pipk = AfeV'ifc- 
By the definition of ■^jt this is equivalent to 

L*2pL2pL*2p'Pk = ^kLlp(pk] 

from L2pL2p(fk — (pk this is equivalent to 

Llp^Pk = ^kL*2p(pk 

On the other hand, by the basic properties of (j)k and ipki we have obviously 
L2pL*2p(pk = hL2pL2p(pk, hence 

L2pL*2p {(pk - h^Pk) = 0. 

Note that both 0jt and (pk satisfy the same zero Dirichlet boundary conditions, 
namely (46) and (48). Hence, by the uniqueness Lemma 32 it follows that 
4>k ~ ^k^k = which implies L2pL2pipk = ^k'^Pk- Thus we see that ijjk is a 
solution to problem (25)- (26) and does not satisfy L2pip = 0. 

(4) The orthogonality to the subspace {v e H^^ : L2pV = 0} follows easily 
from the Green formula (24) apphed to the operator L2pL2p, 

I {L*2pL2pipk ■ V - L2pipk • L2pv) dx 
Jd 

= {SjL2pipk ■ CjV - BjL2pipk ■ Tjv) 

in which substitute the zero boundary conditions (49) of ^fc, and equality 



/ LlpL2pipk ■ vdx = Afc / ipk- vdx. 
Jd J d 
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The orthonormality of the system {ipk}kLi follows now easily by the equal- 
ity 

Afe J ^kipjdx = J LlpL2p^k'ipjdx = J L2pi)kL2pi^jdx = J (pk(pjdx 

and the orthogonality of the system {(pk}kLi ■ 

(5) For the completeness of the system {ipk}kLiJ l^t us assume that for 
some / e 1/2 holds 

[ f ■ ipkdx = / / • ^'kdx = for all A; > 1. (50) 
Jb Jb 

Then the Green formula (24) implies 

= Afc / / • ijjkdx = / / • L*2pL2pijjkdx = / Lap/ • L2pi^kdx 
Jb Jb Jb 

L2pf • (l>kdx for all k > 1. 



By the completeness of the system {(l)k}k>i this imphes that L2pf ~ 0. Prom 
the second orthogonahty in (50) follows that / = 0, and this ends the proof 
of the completeness of the system {■0^ }°^^ U ■ 
■ 

We have used above the following simple result. 
Lemma 32 The solution to problem (45)-(46) for X — is unique. 
Proof. Prom Green's formula (24) we obtain 

/ [I/2p0]^ dx- (f)- L2pL2p(f)dx = ^^^^ ' Q-^2p0 - Bj4> ■ TjL2p4>) day, 

Jb J j=y'dB 

hence L2p4> = 0. 

Now for arbitrary v e H'^^ (B) by the same Green's formula we obtain 

/ {L2p(j) ■ V — (f) ■ L2pv) dx — / (5j0 • CjV — Bj(t) ■ Tjv) day — 0, 
Jb JdB 



hence 



' • L^pVdx = 0. 

B 



Prom the local existence theorem for elliptic operators (cf. [24]) it follows 
that for arbitrary / € I/2 (B) we may solve the elliptic equation L^pV = f 
with V e H"^^ (B) . From the density of H'^^ (B) in L2 (B) we infer = 0. 
This ends the proof. 
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9 Conclusion and open problems 



As in Approximation, Spline and Wavelet Theory ([18], [15]), in the present 
research solutions of higher order elliptic equation have shown flexibility 
which enabled a natural multidimensional generalization of Kolmogorov's 
theory of widths with successful apphcation to multidimensional sets K*. 
Also, new features of Jackson type theorems have been disclosed in Theorem 
22, which shows that one needs components of different dimensions: Xp and 
Fl are of different types. 

It may come as a big surprise, but the present research shows this unam- 
biguously, that in many issues one has to give up the convenient simplistic 
understanding of the multidimensional case, in particular by realizing that 
the finite-dimensional subspaces in (D) , for domains D C M" for n > 2, 
do not serve the same job as the finite-dimensional subspaces in (D) 
for intervals D C R^, and one has to replace them by a lot more sophisti- 
cated objects, namely by the spaces having Harmonic Dimension N. This is 
the main conclusion of the present research based on the successful appli- 
cation of the new Harmonic Widths to explaining the structure of the sets 
K*. 

Beyond the motivational problems mentioned in the Introduction, one 
may formulate several other open problems: 

1. First of all, one has to study basic questions about the sets having 
Harmonic Dimension, by considering the sets XMf]X]s[, XM^Xj^f, 
Xm^Xn, and finding their Harmonic Dimension (if it exists!), etc. 

2. Secondly, one has to prove a generahzation of a theorem of S. Bernstein 
about differentiable Markov systems (or, in the case of differentiabihty. 
Extended Complete Chebyshev systems, in the terminology of [13]). 
As remarked in [23] (after the proof of Theorem 4.2 in chapter 2), S. 
Bernstein dealt with even stronger statement, namely, he was seeking 
Descartes systems (cf. [23]). This needs the factorization of eUiptic 
PDOs into N elliptic operators of second order. These operators will 
be obviously pseudo-differential, [12]. 

3. In this context, one has to check that the maximal generality of the 
theory in the present paper will be achieved by considering elliptic 
pseudo-differential operators. 

4. New Jackson type theorems are suggested by the widths reasons: the 
simplest way to state them is to consider spaces defined by 

{u : \L2pU {x)\ < 1 for X G D} . 
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By arguments similar to the proof of Theorem 22 one is convinced that 
a reasonable Jackson type theorem may be proved only for operators 
P2N of the form P2N = P2N-2p^'2p^ i-^- '^'^^ has to approximate through 
functions -Ua? in the spaces {u : P2NU = in Z^} . In the case of poly- 
harmonic operator Jackson type results have been proved in [17]. 

5. One has to find a proper discrete version of the present research which 
will be essential for the applications to Compressed Sensing, compare 
the role of Gelfand's widths in [9], [8]. 

6. Although we have mentioned the Chcbyshev systems in passing, an 
important point of the present research is the generalization of the Ex- 
tended Complete Chebyshev systems of order (discussed in more 
detail in [16]) which is the ground for the spaces having Harmonic Di- 
mension A^. One has to specify more precisely which are the elliptic 
differential/pseudodiffcrential operators acceptable for a Multidimen- 
sional Chebyshev system. This has to be considered in the context of 
S. Bernstein's one-dimensional result, mentioned in Proposition 1. 

7. In the same direction, let us recall that one-dimensional Chebyshev 
systems are important for the qualitative theory of ODEs, in particu- 
lar for Sturmian type of theorems, cf. e.g. [2], [3]. There has been a 
long search for proper multidimensional generalizations of Chebyshev 
systems. The standard generalization by means of zero set property 
fails to produce a non-trivial multidimensional system and this is the 
content of the theorem of Mairhuber, cf. the thorough discussion in [23] 
(chapter 2, section 1.1). In general, zero set properties and intersec- 
tions are not a reliable reference point for multidimensional Analysis. 
Indeed, let us recall that polyharmonic (and even harmonic) functions 
do not have simple zero sets, however they are solutions to nice Dirich- 
let problems (13) and for that reason are considered to be a genuine 
Multidimensional Chebyshev system as we have defined it in (12). 

V.I. Arnold discusses the importance of the Chebyshev systems in 
his Toronto lectures, June 1997, Lecture 3: Topological Problems in 
Wave Propagation Theory and Topological Economy Principle in Al- 
gebraic Geometry. Fields Institute Communications, available online 
at http://'W'W'w. pdmi.ras.ru/~arnsem/Arnold/arn-papers. html. On p. 
8 he writes that "Even the Sturm theory is missing in higher dimen- 
sions. This is an interesting phenomenon. All attempts that I know 
to extend Sturm theory to higher dimensions failed. For instance, you 
can find such an attempt in the Courant-Hilbert's book, in chapter 6, 
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but it is wrong. The topological theorems about zeros of linear combi- 
nations for higher dimensions, which are attributed there to Herman, 
are wrong even for the standard spherical Laplacian." The attempts 
to mimic multivariate Chebyshev systems are present in the works of 
V.I. Arnold in the context of multivariate Sturm type of theorems, see 
in particular problem 1996-5 in [3]. In view of these efforts of V.I. 
Arnold, one might try to apply the present framework for obtaining 
multidimensional Sturm type theorems. 
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